Local Independence Feature Screening for Nonparametric and Semiparametric Models by Marginal Empirical Likelihood.
نویسندگان
چکیده
We consider an independence feature screening technique for identifying explanatory variables that locally contribute to the response variable in high-dimensional regression analysis. Without requiring a specific parametric form of the underlying data model, our approach accommodates a wide spectrum of nonparametric and semiparametric model families. To detect the local contributions of explanatory variables, our approach constructs empirical likelihood locally in conjunction with marginal nonparametric regressions. Since our approach actually requires no estimation, it is advantageous in scenarios such as the single-index models where even specification and identification of a marginal model is an issue. By automatically incorporating the level of variation of the nonparametric regression and directly assessing the strength of data evidence supporting local contribution from each explanatory variable, our approach provides a unique perspective for solving feature screening problems. Theoretical analysis shows that our approach can handle data dimensionality growing exponentially with the sample size. With extensive theoretical illustrations and numerical examples, we show that the local independence screening approach performs promisingly.
منابع مشابه
Marginal Empirical Likelihood and Sure Independence Feature Screening.
We study a marginal empirical likelihood approach in scenarios when the number of variables grows exponentially with the sample size. The marginal empirical likelihood ratios as functions of the parameters of interest are systematically examined, and we find that the marginal empirical likelihood ratio evaluated at zero can be used to differentiate whether an explanatory variable is contributin...
متن کاملEstimation and model selection of semiparametric multivariate survival functions under general censorship.
We study estimation and model selection of semiparametric models of multivariate survival functions for censored data, which are characterized by possibly misspecified parametric copulas and nonparametric marginal survivals. We obtain the consistency and root-n asymptotic normality of a two-step copula estimator to the pseudo-true copula parameter value according to KLIC, and provide a simple c...
متن کاملIndependent Component Analysis via Nonparametric Maximum Likelihood Estimation By
Independent Component Analysis (ICA) models are very popular semiparametric models in which we observe independent copies of a random vector X =AS, where A is a non-singular matrix and S has independent components. We propose a new way of estimating the unmixing matrix W = A−1 and the marginal distributions of the components of S using nonparametric maximum likelihood. Specifically, we study th...
متن کاملA nonparametric empirical Bayes framework for large-scale multiple testing.
We propose a flexible and identifiable version of the 2-groups model, motivated by hierarchical Bayes considerations, that features an empirical null and a semiparametric mixture model for the nonnull cases. We use a computationally efficient predictive recursion (PR) marginal likelihood procedure to estimate the model parameters, even the nonparametric mixing distribution. This leads to a nonp...
متن کاملSemiparametric inference in mixture models with predictive recursion
Predictive recursion (PR) is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, PR fails to account for any uncertainty in the additional unknown structural parameter. As an alternative to existing PR profile likelihood methods, we treat PR as a filter-like approximation to fitting a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Annals of statistics
دوره 44 2 شماره
صفحات -
تاریخ انتشار 2016